Systems and methods for generating prediction queries

ABSTRACT

Systems and methods are provided for generating prediction queries to help a user build and execute prediction queries. A user interface (UI) is provided that is easy to use and understand in connection with the generation of a prediction query for data mining. The UI can be instantiated from a variety of disparate sources that may request query building services. While prediction queries and relational queries are quite different, the UI enables prediction queries to be built in a manner that is similar to the way relational queries are built. In one embodiment, the main screen of the UI includes four main components: (1) a table column mapping area, (3) a selection grid area, (4) a query text display area and (5) a query result grid area. In one embodiment, the query text display area and the query result grid area are initially not presented to the user.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.10/177,824 filed Jun. 21, 2002 entitled “Systems and Methods forGenerating Prediction Queries,” which is hereby incorporated byreference in its entirety.

FIELD OF THE INVENTION

The present invention is directed to systems and methods for generatingand executing prediction queries.

BACKGROUND OF THE INVENTION

A prediction query for data mining (DM) applies a prediction model totransactional data, or other kinds of data, and generates predictiveresults that can serve as the basis for sound business decisions inmarketing, operations, budgeting and many other areas as well. Theadvantages and capabilities for data mining are similar to those ofOn-Line Analytical Processing (OLAP), but break much more ground. LikeOLAP, DM exists to help one obtain qualitative information fromotherwise dry, transactional data. While OLAP achieves this byoptimizing drill-down queries and letting users observe patterns indata, DM actively analyzes data and determines patterns on its own. DMis based in part on artificial intelligence (AI) principles andalgorithms, and is also based heavily on statistics. DM is relevant to avariety of applications, including, but not limited to, client/serverapplications and services, data warehousing, web site personalization,on-line customer assessment, fraud detection, etc.

FIG. 1 illustrates an exemplary prior art user interface for arelational query builder 30. For instance, join operations betweenrelational tables 40 and 42 can be specified, and automatic mappings 44are created between tables 40 and 42. Grid view 50 enables a user toselect, e.g., “drag and drop,” columns from any of the tables to thegrid in order to build a join query in a relational system. Relationalquery builder 30 thus provides a standard way to build relationalqueries; however, to date, there is no standard way to build aprediction query.

An application or object that allows prediction models to be built usingdata mining algorithms is sometimes called a prediction query builder orgenerator. A prediction query builder typically can be applied to avariety of kinds and sizes of databases. In this regard, a predictionquery builder enables the incorporation of predictive data mining models(DMM) from wherever they may be located. A DMM is like a relationaltable, except that it typically includes special columns that can beused for data training and prediction making, i.e., the DMM enables boththe creation of a prediction model and the generation of predictions.Unlike a standard relational table, though, which stores raw data, a DMMstores the patterns discovered by the particular data mining algorithmthat was utilized.

A prediction join operation is an operation that is mapped to a joinquery between a trained data mining model and a designated input datasource so that one can generate a tailored prediction result. Theprediction result can then be stored, interpreted, output or displayedin a variety of formats.

Whatever the platform may be to interact with the data, in order toaccess the data to be mined, a DM engine formulates a query according tothe format of the platform, e.g., SQL Server, in which the data isstored. Regardless of the platform, describing a prediction query in anunambiguous way can be challenging. Thus, creating prediction queriesfrom scratch can be a complex, tedious and error-prone process. Amongall other data mining tools currently available in the marketplace,there is no product that provides a simple, graphical way to build aprediction query. Thus, there exists a need in data mining products fora tool that can assist a user in building and executing a data miningprediction query in a standard manner, simply and easily. There is stillfurther a need for a prediction query builder that allows a user tobuild data mining queries in a manner similar to building/executingrelational join queries. There is thus a need for improvement over theseand other deficiencies of the prior art.

SUMMARY OF THE INVENTION

In view of the foregoing, the present invention provides systems andmethods for generating prediction queries to help a user build andexecute prediction queries. A user interface (UI) is provided that iseasy to use and understand in connection with the generation of aprediction query for data mining, and the UI can be instantiated from avariety of disparate sources that may request query building services.While prediction queries and relational queries are quite different, theUI of the invention enables prediction queries to be built in a mannerthat is similar to the way relational queries are built. In oneembodiment, the main screen of the UI includes four main components: (1)a table column mapping area, (2) a selection grid area, (3) a query textdisplay area and (4) a query result grid area. In one embodiment, thequery text display area and the query result grid area are initiallyinvisible.

Other features and embodiments of the present invention are describedbelow.

BRIEF DESCRIPTION OF THE DRAWINGS

The file of this patent includes at least one drawing executed in color.Copies of this patent with color drawings will be provided by the UnitedStates Patent and Trademark Office upon request and payment of thenecessary fee.

The system and methods for generating prediction queries in accordancewith the present invention are further described with reference to theaccompanying drawings in which:

FIG. 1 is a prior art illustration of a UI for a relational querybuilder;

FIG. 2A is a block diagram representing an exemplary network environmenthaving a variety of computing devices in which the present invention maybe implemented;

FIG. 2B is a block diagram representing an exemplary non-limitingcomputing device in which the present invention may be implemented;

FIGS. 3A and 3B illustrate a main screen of an exemplary embodiment ofthe UI of the invention;

FIG. 4 illustrates an exemplary display of query syntax of a predictionquery in accordance with the present invention;

FIG. 5 illustrates exemplary results of an execution of a predictionquery in accordance with the invention;

FIG. 6 illustrates an exemplary table mapping column area in accordancewith the invention;

FIGS. 7A to 7C illustrate exemplary aspects of inputting mining model(s)and input table(s) in accordance with the invention;

FIG. 8 illustrates automatic mapping of model names and table names inaccordance with the invention;

FIGS. 9A and 9B illustrate exemplary aspects of a selection grid area inaccordance with the invention; and

FIG. 10 illustrates an exemplary generation of a prediction query andassociated syntax in accordance with the invention.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

Overview

As explained in the background, there exists a need in data mining for atool that can assist a user in building and executing a data miningprediction query. The prediction query builder of the present inventionallows a user to build data mining queries in a manner similar tobuilding/executing relational join queries. In one aspect, the datamining model is treated similarly to a relational table and predictionsare treated similarly to a join operation. However, instead of joiningtwo relational tables, the present invention joins a relational tablewith a mining model. An improved UI permits a user to use line segmentsto mark the join condition and build the query simply and easily. In oneembodiment, the main screen of the UI includes four main components: (1)a table column mapping area, (2) a selection grid area, (3) a query textdisplay area and (4) a query result grid area. In one embodiment, thequery text display area and the query result grid area are initially notpresented to the user.

Exemplary Networked and Distributed Environments

One of ordinary skill in the art can appreciate that a computer or otherclient or server device can be deployed as part of a computer network,or in a distributed computing environment. In this regard, the presentinvention pertains to any computer system having any number of memory orstorage units, and any number of applications and processes occurringacross any number of storage units or volumes, which may be used inconnection with a prediction query generation process. The presentinvention may apply to an environment with server computers and clientcomputers deployed in a network environment or distributed computingenvironment, having remote or local storage. The present invention mayalso be applied to standalone computing devices, having programminglanguage functionality, interpretation and execution capabilities forgenerating, receiving and transmitting information in connection withremote or local prediction query generation services.

Distributed computing facilitates sharing of computer resources andservices by direct exchange between computing devices and systems. Theseresources and services include the exchange of information, cachestorage, and disk storage for files. Distributed computing takesadvantage of network connectivity, allowing clients to leverage theircollective power to benefit the entire enterprise. In this regard, avariety of devices may have applications, objects or resources that mayimplicate a prediction query generation process that may utilize thetechniques of the present invention.

FIG. 2A provides a schematic diagram of an exemplary networked ordistributed computing environment. The distributed computing environmentcomprises computing objects 10 a, 10 b, etc. and computing objects ordevices 110 a, 110 b, 110 c, etc. These objects may comprise programs,methods, data stores, programmable logic, etc. The objects may compriseportions of the same or different devices such as personal digitalassistants (PDAs), televisions, Moving Picture Experts Group (MPEG-1)Audio Layer-3 (MP3) players, televisions, personal computers, etc. Eachobject can communicate with another object by way of the communicationsnetwork 14. This network may itself comprise other computing objects andcomputing devices that provide services to the system of FIG. 2A. Inaccordance with an aspect of the invention, each object 10 a, 10 b, etc.or 110 a, 110 b, 110 c, etc. may contain an application that mightrequest forward mapping services.

In a distributed computing architecture, computers, which may havetraditionally been used solely as clients, communicate directly amongthemselves and can act as both clients and servers, assuming whateverrole is most efficient for the network. This reduces the load on serversand allows all of the clients to access resources available on otherclients, thereby increasing the capability and efficiency of the entirenetwork. Prediction query generation and execution services andinterfaces in accordance with the present invention may thus bedistributed among clients and servers, acting in a way that is efficientfor the entire network.

Distributed computing can help businesses deliver services andcapabilities more efficiently across diverse geographic boundaries.Moreover, distributed computing can move data closer to the point wheredata is consumed acting as a network caching mechanism. Distributedcomputing also allows computing networks to dynamically work togetherusing intelligent agents. Agents reside on peer computers andcommunicate various kinds of information back and forth. Agents may alsoinitiate tasks on behalf of other peer systems. For instance,intelligent agents can be used to prioritize tasks on a network, changetraffic flow, search for files locally or determine anomalous behaviorsuch as a virus and stop it before it affects the network. All sorts ofother services may be contemplated as well. Since data may in practicebe physically located in one or more locations, the ability todistribute prediction query generation and execution services andinterfaces is of great utility in such a system.

It can also be appreciated that an object, such as 110 c, may be hostedon another computing device 10 a, 10 b, etc. or 110 a, 110 b, etc. Thus,although the physical environment depicted may show the connecteddevices as computers, such illustration is merely exemplary and thephysical environment may alternatively be depicted or describedcomprising various digital devices such as PDAs, televisions, MP3players, etc., software objects such as interfaces, COM objects and thelike.

There are a variety of systems, components, and network configurationsthat support distributed computing environments. For example, computingsystems may be connected together by wireline or wireless systems, bylocal networks or widely distributed networks. Currently, many of thenetworks are coupled to the Internet, which provides the infrastructurefor widely distributed computing and encompasses many differentnetworks.

In home networking environments, there are at least four disparatenetwork transport media that may each support a unique protocol, such asPower line, data (both wireless and wired), voice, e.g., telephone, andentertainment media. Most home control devices such as light switchesand appliances may use power line for connectivity. Data Services mayenter the home as broadband (e.g., either DSL or Cable modem) and areaccessible within the home using either wireless, e.g., Home RadioFrequency (HomeRF) or 802.11b, or wired, e.g., Home Phoneline NetworkingAppliance (PNA), Cat 5, even power line, connectivity. Voice traffic mayenter the home either as wired, e.g., Cat 3, or wireless, e.g., cellphones, and may be distributed within the home using Cat 3 wiring.Entertainment media, or other data, may enter the home either throughsatellite or cable and is typically distributed in the home usingcoaxial cable. IEEE 1394 and digital video interface (DVI) are alsoemerging as digital interconnects for clusters of media devices. All ofthese network environments and others that may emerge as protocolstandards may be interconnected to form an intranet that may beconnected to the outside world by way of the Internet. In short, avariety of disparate sources exist for the storage and transmission ofdata, and consequently, moving forward, computing devices will requireways of sharing data, such as data accessed or utilized incident toprediction query generation and execution in accordance with the presentinvention.

The Internet commonly refers to the collection of networks and gatewaysthat utilize the Transport Control Protocol/Interface Program (TCP/IP)suite of protocols, which are well-known in the art of computernetworking. The Internet can be described as a system of geographicallydistributed remote computer networks interconnected by computersexecuting networking protocols that allow users to interact and shareinformation over the networks. Because of such wide-spread informationsharing, remote networks such as the Internet have thus far generallyevolved into an open system for which developers can design softwareapplications for performing specialized operations or services,essentially without restriction.

Thus, the network infrastructure enables a host of network topologiessuch as client/server, peer-to-peer, or hybrid architectures. The“client” is a member of a class or group that uses the services ofanother class or group to which it is not related. Thus, in computing, aclient is a process, i.e., roughly a set of instructions or tasks, thatrequests a service provided by another program. The client processutilizes the requested service without having to “know” any workingdetails about the other program or the service itself. In aclient/server architecture, particularly a networked system, a client isusually a computer that accesses shared network resources provided byanother computer, e.g., a server. In the example of FIG. 2A, computers110 a, 110 b, etc. can be thought of as clients and computer 10 a, 10 b,etc. can be thought of as the server where server 10 a, 10 b, etc.maintains the data that is then replicated in the client computers 110a, 110 b, etc.

A server is typically a remote computer system accessible over a remotenetwork such as the Internet. The client process may be active in afirst computer system, and the server process may be active in a secondcomputer system, communicating with one another over a communicationsmedium, thus providing distributed functionality and allowing multipleclients to take advantage of the information-gathering capabilities ofthe server.

Client and server communicate with one another utilizing thefunctionality provided by a protocol layer. For example,Hypertext-Transfer Protocol (HTTP) is a common protocol that is used inconjunction with the World Wide Web (WWW). Typically, a computer networkaddress such as a Universal Resource Locator (URL) or an InternetProtocol (IP) address is used to identify the server or client computersto each other. The network address can be referred to as a URL address.For example, communication can be provided over a communications medium.In particular, the client and server may be coupled to one another viaTCP/IP connections for high-capacity communication.

Thus, FIG. 2A illustrates an exemplary networked or distributedenvironment, with a server in communication with client computers via anetwork/bus, in which the present invention may be employed. In moredetail, a number of servers 10 a, 10 b, etc., are interconnected via acommunications network/bus 14, which may be a LAN, WAN, intranet, theInternet, etc., with a number of client or remote computing devices 110a, 110 b, 110 c, 110 d, 110 e, etc., such as a portable computer,handheld computer, thin client, networked appliance, or other device,such as a video cassette recorder (VCR), television (TV), oven, light,heater and the like in accordance with the present invention. It is thuscontemplated that the present invention may apply to any computingdevice in connection with which it is desirable to process or displayprediction data.

In a network environment in which the communications network/bus 14 isthe Internet, for example, the servers 10 a, 10 b, etc. can be Webservers with which the clients 110 a, 110 b, 110 c, 110 d, 110 e, etc.communicate via any of a number of known protocols such as HTTP. Servers10 a, 10 b, etc. may also serve as clients 110 a, 110 b, 110 c, 110 d,110 e, etc., as may be characteristic of a distributed computingenvironment. Communications may be wired or wireless, where appropriate.Client devices 110 a, 110 b, 110 c, 110 d, 110 e, etc. may or may notcommunicate via communications network/bus 14, and may have independentcommunications associated therewith. For example, in the case of a TV orVCR, there may or may not be a networked aspect to the control thereof.Each client computer 110 a, 110 b, 110 c, 110 d, 110 e, etc. and servercomputer 10 a, 10 b, etc. may be equipped with various applicationprogram modules or objects 135 and with connections or access to varioustypes of storage elements or objects, across which files may be storedor to which portion(s) of files or images may be downloaded or migrated.Any computer 10 a, 10 b, 110 a, 110 b, etc. may be responsible for themaintenance and updating of a database 20 or other storage element inaccordance with the present invention, such as a database or memory 20for storing data or intermediate object(s) processed according to theinvention. Thus, the present invention can be utilized in a computernetwork environment having client computers 110 a, 110 b, etc. that canaccess and interact with a computer network/bus 14 and server computers10 a, 10 b, etc. that may interact with client computers 110 a, 110 b,etc. and other like devices, and databases 20.

Exemplary Computing Device

FIG. 2B and the following discussion are intended to provide a briefgeneral description of a suitable computing environment in which theinvention may be implemented. It should be understood, however, thathandheld, portable and other computing devices and computing objects ofall kinds are contemplated for use in connection with the presentinvention, as described above. Thus, while a general purpose computer isdescribed below, this is but one example, and the present invention maybe implemented with other computing devices, such as a thin clienthaving network/bus interoperability and interaction. Thus, the presentinvention may be implemented in an environment of networked hostedservices in which very little or minimal client resources areimplicated, e.g., a networked environment in which the client deviceserves merely as an interface to the network/bus, such as an objectplaced in an appliance, or other computing devices and objects as well.In essence, anywhere that data may be stored or from which data may beretrieved is a desirable, or suitable, environment for operation of theprediction query generation and execution techniques of the invention.

Although not required, the invention can be implemented via an operatingsystem, for use by a developer of services for a device or object,and/or included within application software that operates in connectionwith the prediction query generation and execution techniques of theinvention. Software may be described in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by one or more computers, such as client workstations, serversor other devices. Generally, program modules include routines, programs,objects, components, data structures and the like that performparticular tasks or implement particular abstract data types. Typically,the functionality of the program modules may be combined or distributedas desired in various embodiments. Moreover, those skilled in the artwill appreciate that the invention may be practiced with other computersystem configurations. Other well known computing systems, environments,and/or configurations that may be suitable for use with the inventioninclude, but are not limited to, personal computers (PCs), automatedteller machines, server computers, hand-held or laptop devices,multi-processor systems, microprocessor-based systems, programmableconsumer electronics, network PCs, appliances, lights, environmentalcontrol elements, minicomputers, mainframe computers and the like. Theinvention may also be practiced in distributed computing environmentswhere tasks are performed by remote processing devices that are linkedthrough a communications network/bus or other data transmission medium.In a distributed computing environment, program modules may be locatedin both local and remote computer storage media including memory storagedevices, and client nodes may in turn behave as server nodes.

FIG. 2B thus illustrates an example of a suitable computing systemenvironment 100 in which the invention may be implemented, although asmade clear above, the computing system environment 100 is only oneexample of a suitable computing environment and is not intended tosuggest any limitation as to the scope of use or functionality of theinvention. Neither should the computing environment 100 be interpretedas having any dependency or requirement relating to any one orcombination of components illustrated in the exemplary operatingenvironment 100.

With reference to FIG. 2B, an exemplary system for implementing theinvention includes a general purpose computing device in the form of acomputer 110. Components of computer 110 may include, but are notlimited to, a processing unit 120, a system memory 130, and a system bus121 that couples various system components including the system memoryto the processing unit 120. The system bus 121 may be any of severaltypes of bus structures including a memory bus or memory controller, aperipheral bus, and a local bus using any of a variety of busarchitectures. By way of example, and not limitation, such architecturesinclude Industry Standard Architecture (ISA) bus, Micro ChannelArchitecture (MCA) bus, Enhanced ISA (EISA) bus, Video ElectronicsStandards Association (VESA) local bus, and Peripheral ComponentInterconnect (PCI) bus (also known as Mezzanine bus).

Computer 110 typically includes a variety of computer readable media.Computer readable media can be any available media that can be accessedby computer 110 and includes both volatile and nonvolatile media,removable and non-removable media. By way of example, and notlimitation, computer readable media may comprise computer storage mediaand communication media. Computer storage media includes both volatileand nonvolatile, removable and non-removable media implemented in anymethod or technology for storage of information such as computerreadable instructions, data structures, program modules or other data.Computer storage media includes, but is not limited to, Random AccessMemory (RAM), Read Only Memory (ROM), Electrically Erasable ProgrammableRead Only Memory (EEPROM), flash memory or other memory technology,Compact Disk Read Only Memory (CDROM), digital versatile disks (DVD) orother optical disk storage, magnetic cassettes, magnetic tape, magneticdisk storage or other magnetic storage devices, or any other mediumwhich can be used to store the desired information and which canaccessed by computer 110. Communication media typically embodiescomputer readable instructions, data structures, program modules orother data in a modulated data signal such as a carrier wave or othertransport mechanism and includes any information delivery media. Theterm “modulated data signal” means a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, and not limitation, communicationmedia includes wired media such as a wired network or direct-wiredconnection, and wireless media such as acoustic, RF, infrared and otherwireless media. Combinations of any of the above should also be includedwithin the scope of computer readable media.

The system memory 130 includes computer storage media in the form ofvolatile and/or nonvolatile memory such as read only memory (ROM) 131and random access memory (RAM) 132. A basic input/output system 133(BIOS), containing the basic routines that help to transfer informationbetween elements within computer 110, such as during start-up, istypically stored in ROM 131. RAM 132 typically contains data and/orprogram modules that are immediately accessible to and/or presentlybeing operated on by processing unit 120. By way of example, and notlimitation, FIG. 2B illustrates operating system 134, applicationprograms 135, other program modules 136, and program data 137.

The computer 110 may also include other removable/non-removable,volatile/nonvolatile computer storage media. By way of example only,FIG. 2B illustrates a hard disk drive 141 that reads from or writes tonon-removable, nonvolatile magnetic media, a magnetic disk drive 151that reads from or writes to a removable, nonvolatile magnetic disk 152,and an optical disk drive 155 that reads from or writes to a removable,nonvolatile optical disk 156, such as a CD ROM or other optical media.Other removable/non-removable, volatile/nonvolatile computer storagemedia that can be used in the exemplary operating environment include,but are not limited to, magnetic tape cassettes, flash memory cards,digital versatile disks, digital video tape, solid state RAM, solidstate ROM, and the like. The hard disk drive 141 is typically connectedto the system bus 121 through an non-removable memory interface such asinterface 140, and magnetic disk drive 151 and optical disk drive 155are typically connected to the system bus 121 by a removable memoryinterface, such as interface 150.

The drives and their associated computer storage media discussed aboveand illustrated in FIG. 2B provide storage of computer readableinstructions, data structures, program modules and other data for thecomputer 110. In FIG. 2B, for example, hard disk drive 141 isillustrated as storing operating system 144, application programs 145,other program modules 146, and program data 147. Note that thesecomponents can either be the same as or different from operating system134, application programs 135, other program modules 136, and programdata 137. Operating system 144, application programs 145, other programmodules 146, and program data 147 are given different numbers here toillustrate that, at a minimum, they are different copies. A user mayenter commands and information into the computer 110 through inputdevices such as a keyboard 162 and pointing device 161, commonlyreferred to as a mouse, trackball or touch pad. Other input devices (notshown) may include a microphone, joystick, game pad, satellite dish,scanner, or the like. These and other input devices are often connectedto the processing unit 120 through a user input interface 160 that iscoupled to the system bus 121, but may be connected by other interfaceand bus structures, such as a parallel port, game port or a universalserial bus (USB). A graphics interface 182, such as Northbridge, mayalso be connected to the system bus 121. Northbridge is a chipset thatcommunicates with the CPU, or host processing unit 120, and assumesresponsibility for accelerated graphics port (AGP) communications. Oneor more graphics processing units (GPUs) 184 may communicate withgraphics interface 182. In this regard, GPUs 184 generally includeon-chip memory storage, such as register storage and GPUs 184communicate with a video memory 186. GPUs 184, however, are but oneexample of a coprocessor and thus a variety of coprocessing devices maybe included in computer 110. A monitor 191 or other type of displaydevice is also connected to the system bus 121 via an interface, such asa video interface 190, which may in turn communicate with video memory186. In addition to monitor 191, computers may also include otherperipheral output devices such as speakers 197 and printer 196, whichmay be connected through an output peripheral interface 195.

The computer 110 may operate in a networked or distributed environmentusing logical connections to one or more remote computers, such as aremote computer 180. The remote computer 180 may be a personal computer,a server, a router, a network PC, a peer device or other common networknode, and typically includes many or all of the elements described aboverelative to the computer 110, although only a memory storage device 181has been illustrated in FIG. 2B. The logical connections depicted inFIG. 2B include a local area network (LAN) 171 and a wide area network(WAN) 173, but may also include other networks/buses. Such networkingenvironments are commonplace in homes, offices, enterprise-wide computernetworks, intranets and the Internet.

When used in a LAN networking environment, the computer 110 is connectedto the LAN 171 through a network interface or adapter 170. When used ina WAN networking environment, the computer 110 typically includes amodem 172 or other means for establishing communications over the WAN173, such as the Internet. The modem 172, which may be internal orexternal, may be connected to the system bus 121 via the user inputinterface 160, or other appropriate mechanism. In a networkedenvironment, program modules depicted relative to the computer 110, orportions thereof, may be stored in the remote memory storage device. Byway of example, and not limitation, FIG. 2B illustrates remoteapplication programs 185 as residing on memory device 181. It will beappreciated that the network connections shown are exemplary and othermeans of establishing a communications link between the computers may beused.

Exemplary Distributed Computing Frameworks or Architectures

Various distributed computing frameworks have been and are beingdeveloped in light of the convergence of personal computing and theInternet. Individuals and business users alike are provided with aseamlessly interoperable and Web-enabled interface for applications andcomputing devices, making computing activities increasingly Web browseror network-oriented.

For example, MICROSOFT®'s .NET platform includes servers, building-blockservices, such as Web-based data storage and downloadable devicesoftware. Generally speaking, the .NET platform provides (1) the abilityto make the entire range of computing devices work together and to haveuser information automatically updated and synchronized on all of them,(2) increased interactive capability for Web sites, enabled by greateruse of XML rather than HTML, (3) online services that feature customizedaccess and delivery of products and services to the user from a centralstarting point for the management of various applications, such ase-mail, for example, or software, such as Office .NET, (4) centralizeddata storage, which will increase efficiency and ease of access toinformation, as well as synchronization of information among users anddevices, (5) the ability to integrate various communications media, suchas e-mail, faxes, and telephones, (6) for developers, the ability tocreate reusable modules, thereby increasing productivity and reducingthe number of programming errors and (7) many other cross-platformintegration features as well.

While exemplary embodiments herein are described in connection withsoftware residing on a computing device, one or more portions of theinvention may also be implemented via an operating system, applicationprogramming interface (API) or a “middle man” object between any of acoprocessor, a display device and requesting object, such thatprediction query generation and execution services may be performed by,supported in or accessed via all of .NET's languages and services, andin other distributed computing frameworks as well.

Data Mining Prediction Query Building

The present invention thus provides systems and methods for generatingprediction queries to help a user build and execute prediction queries.A UI is provided that is easy to use and understand in connection withthe generation of a prediction query for data mining, and the UI can beinstantiated from a variety of disparate sources that may request querybuilding services. In one embodiment, users are able to build datamining prediction queries in a way that is intuitively similar tobuilding a join query for data restricted to relational database(s).

As mentioned above, there exists a need in data mining products for atool that can assist a user in building data mining prediction queriesin a standard manner. In one aspect, the prediction query builder of theinvention allows a user to build data mining queries in a manner similarto building/executing relational join queries. The data mining model istreated like a relational table and a prediction is treated like a joinoperation, however, instead of joining two relational tables, theinvention enables the joining of a relational table with a mining model.At least one difference between join operations in connection with arelational query builder and join operations in connection with aprediction query builder is that a relational query builder joins thetables such that the data in each table can be related, e.g., records intable A and corresponding records in table B can be related in somefashion depending on the join type whereas the prediction query builderof the invention joins lines by mapping columns from the sourcerelational data to corresponding columns in the mining model. In therelational case, both tables are input data. In the prediction querybuilder case, mapping(s) are defined from at least one source table tothe mining model definition so that when the query is executed, themining model receives data fed into the correct columns. Otherdifferences may be evident from further description herein. Towards theabove goal(s), an improved UI is provided in accordance with theinvention, which permits a user to specify simple two point “A-B” or“B-A” line segments to mark the join condition and build the query.

The invention thus helps users to build data mining prediction queries,which can otherwise become a complex detail-oriented query draftingtask. In one embodiment, the tool of the invention is similar to somerelational query builder tools.

One of the open issues for data mining products is to allow user tobuild a prediction query. As mentioned in the background, most productsdo not include a query language for data mining. Some other products doprovide query languages for data mining prediction; however, theselanguages are very different than languages used for relationaldatabases, and it is very difficult to write without specific expertiseto do so.

The invention thus proposes a way to help user to build/execute datamining prediction queries in the same way as building/executingrelational join queries. A data mining model is thus considered in a waythat is similar to the way a relational table is traditionally treated.A prediction query is thus considered a join; however, instead ofjoining two relational tables, a relational table is joined with a datamining model. A user can delineate line segments by any input means,e.g., mouse, keyboard, trackball, joystick, tablet pad, etc., to markthe join condition. The following figures illustrate some of the mainconcepts of the prediction query builder tool of the invention.

For instance, FIGS. 3A and 3B illustrate a prediction query builder mainscreen. FIGS. 3A and 3B are the main query design screen, with a firstportion (the top part in this design) and a second portion (the bottompart in this design). In the top part, or first portion 300, there aretwo frames 302 and 310 with tree views. The left one 302 is a miningmodel with mining model columns shown by familiar file structure 304 a.The predictable column 304 b (member_card in this case) has a diamondicon. Frame 302 includes a select model link 306 to select a model in afamiliar way. In other embodiments of the invention, links, such aslinks 306, are implemented as other kinds of UI elements, such asstandard buttons and the like. The right frame 310 is the schema of arelational table. Frame 310 includes a modify join link 312, a deletetable link 314 and a select nested table link 316. The nested table link316 enables a user to link tables having specific hierarchical andnested relationships according to their relationships. A user can thenlink columns between mining models 304 b and input tables 318 by drawingline segments 319, using any conventional input means, similar to theway a user builds a join query in a relational system. The bottom part320 is the selection grid. With the selection grid, a user can select,e.g., “drag and drop,” columns from any of the top tree views to thegrid, similar to the way a user builds join query in a relationalsystem. Also, similar to a relational grid and described in more detailbelow, a user can utilize dropdown controls, or other suitable controls,in the grid to instead select columns of a mining model, variousfunctions, or define custom expressions in the grid. Exemplaryembodiments of grid 320 are illustrated in FIGS. 9A and 9B below.

Contribution(s) of the invention, shown in FIGS. 3A and 3B, include, butare not limited to, the display of data mining model as a relationaltable, and the adoption of a query builder UI familiar to users to builddata mining prediction queries. No other data mining products have thusfar used these concepts.

FIG. 4 illustrates a prediction query builder SQL view 330 based on thequery designed in FIG. 3A. In this particular non-limiting example, thequery syntax is based on object linking and embedding database (OLE DB)for DM query language. This is similar to a SQL view in a traditionalrelational query builder, but instead is suited to prediction queries.One can see from this example that the prediction query automaticallygenerated by the simple join operations of the invention is quitecomplex.

FIG. 5 is a prediction query builder grid view 340, which displays theresult(s) of the prediction query, after the prediction query generatedin FIG. 4 has been executed. This is similar to the grid view shown asthe result of a traditional join operation in the relational databasecontext. While not illustrated, if the mining model contains nestedtables, the result grid 340 of the invention also supports hierarchicalresults.

Data mining prediction is an important step in data mining, and thusproviding a product having new functionality with a look and feel thatmany users can already appreciate is an objective achieved in accordancewith the invention. The invention thus adopts a classic relation querybuilder UI to help a user to generate/execute prediction queries.

As mentioned above in connection with FIGS. 3A and 3B, the main screenof the UI includes four main components: (1) a table column mappingarea, (2) a selection grid area, (3) a query text display area and (4) aquery result grid area. In one embodiment, the query text display areaand the query result grid area are initially invisible.

The invention will now be described with reference to various moredetailed, but non-limiting embodiments. In connection with the tablecolumn mapping area 300, at the initial stage, as shown in FIG. 6, theuser specifies the mining model based upon which prediction is going totake place by selecting link 306.

The select mining model list box 700 shown in FIG. 7A displays the listof mining models in the solution. It is possible for the user to selecta mining model within the project, or refer to an existing model from aserver. In one embodiment, the default mining model is the first one inthe list of derived mining models.

Once the model is selected, the hyper link 316 to “Select one or moreinput tables” becomes enabled. The user can follow the hyper link 316 toselect the input tables based on the mining model structure selected.Thus, once the mining model is selected, the user can pick input tablesfor prediction (the ‘Select tables’ link 316 is enabled). While clickingon the link, the user is prompted if he wants to select the table fromexisting Data Source Views (DSVs) or from a live server.

FIG. 7B illustrates an exemplary “Selecting case table or nested tablesfor prediction” UI object 710, enabling a user to select input sourceobjects. Then, as illustrated in FIG. 7C, if there are nested tables,the user draws the mapping 720 between the case table and any nestedtables.

As illustrated in FIG. 8, when the table selection wizard is done, theuser is returned to the prediction query builder main screen with thecolumns of the input table populated as per the selections of FIGS. 7Band 7C. Columns from model and tables, which have same name, are thenautomatically mapped.

FIGS. 9A and 9B illustrate exemplary implementations for a grid 320 a orgrid 320 b, on which a user can select, e.g., drag-drop, columns frommining model columns, input table columns and available predictionfunctions. The source column 321 allows a user to select columns fromthe mining model, input tables, prediction functions or user expression.The Field column 322 allows the user to pick the columns or predictionfunctions. The alias column 323 gives the user the option to rename thedisplay name of a column in the result grid view. The show column 324gives the user the option to show a source in the grid 320 a or 320 b.The Group column 325 allows the user to group Boolean expressionstogether while the And/Or column 326 allows a user to specify theexpression. The user can type the condition or user expression in thecriteria column 327.

FIG. 10 illustrates another exemplary prediction query 1000 generated inaccordance with the invention showing how complicated such a query canbe. The simple selection and mapping/join operation of the inventiongenerates such complex queries automatically and thus is of greatutility from the standpoint of preventing mistakes, and saving time inlearning and programming prediction query syntax. In one embodiment, viaany common input means, e.g., keyboard and the like, a user can manuallyedit text generated by the builder, e.g., SQL syntax, and save themodifications. This functionality is optionally provided forconvenience, and, in one implementation, the builder does not load UIstate from the query text, i.e., the UI does not reflect changes to thequery text.

Exemplary items in the toolbar for the UI of the invention include: (1)Save, which saves a query, (2) Open, which opens a query, (3) Run, whichexecutes the query, Show syntax, which displays the query syntax in awindow and (5) Design/Grid Viewer toggle, which switches back to thedesign view or to the query result view.

In one embodiment, the invention provides support for a singleton query,wherein a choice is added at the bottom of the Input Table Grid, whichinvokes a hierarchical grid with two columns: Attribute and Value. Theuser can type the value for some attributes and when returned to themain screen, the columns associated with the values are automaticallymapped.

CONCLUSION

The Data Mining (DM) prediction query builder, or generator, of theinvention is a data mining tool that helps a user to build and executeprediction queries. In this regard, the present invention provides auser interface (UI) that is easy to use and understand in connectionwith the generation of a query for data mining, and can be instantiatedfrom a variety of disparate sources that may request query buildingservices. It is noted that a relational query and a prediction query areunrelated in purpose and effect; however, in one aspect, the UI of thisinvention includes a “feel and effect” similar to a relational querybuilding model.

As mentioned above, while exemplary embodiments of the present inventionhave been described in connection with various computing devices andnetwork architectures, the underlying concepts may be applied to anycomputing device or system in which it is desirable to generate andexecute prediction queries. Thus, the techniques for providingprediction query generation and execution in accordance with the presentinvention may be applied to a variety of applications and devices. Forinstance, the algorithm(s) of the invention may be applied to theoperating system of a computing device, provided as a separate object onthe device, as part of another object, as a downloadable object from aserver, as a “middle man” between a device or object and the network, asa distributed object, etc. While exemplary programming languages, namesand examples are chosen herein as representative of various choices,these languages, names and examples are not intended to be limiting. Oneof ordinary skill in the art will appreciate that there are numerousways of providing object code that achieves the same, similar orequivalent prediction query generation and execution achieved by theinvention.

The various techniques described herein may be implemented in connectionwith hardware or software or, where appropriate, with a combination ofboth. Thus, the methods and apparatus of the present invention, orcertain aspects or portions thereof, may take the form of program code(i.e., instructions) embodied in tangible media, such as floppydiskettes, CD-ROMs, hard drives, or any other machine-readable storagemedium, wherein, when the program code is loaded into and executed by amachine, such as a computer, the machine becomes an apparatus forpracticing the invention. In the case of program code execution onprogrammable computers, the computing device will generally include aprocessor, a storage medium readable by the processor (includingvolatile and non-volatile memory and/or storage elements), at least oneinput device, and at least one output device. One or more programs thatmay utilize the signal processing services of the present invention,e.g., through the use of a data processing API or the like, arepreferably implemented in a high level procedural or object orientedprogramming language to communicate with a computer system. However, theprogram(s) can be implemented in assembly or machine language, ifdesired. In any case, the language may be a compiled or interpretedlanguage, and combined with hardware implementations.

The methods and apparatus of the present invention may also be practicedvia communications embodied in the form of program code that istransmitted over some transmission medium, such as over electricalwiring or cabling, through fiber optics, or via any other form oftransmission, wherein, when the program code is received and loaded intoand executed by a machine, such as an EPROM, a gate array, aprogrammable logic device (PLD), a client computer, a video recorder orthe like, or a receiving machine having the signal processingcapabilities as described in exemplary embodiments above becomes anapparatus for practicing the invention. When implemented on ageneral-purpose processor, the program code combines with the processorto provide a unique apparatus that operates to invoke the functionalityof the present invention. Additionally, any storage techniques used inconnection with the present invention may invariably be a combination ofhardware and software.

While the present invention has been described in connection with thepreferred embodiments of the various figures, it is to be understoodthat other similar embodiments may be used or modifications andadditions may be made to the described embodiment for performing thesame function of the present invention without deviating therefrom. Forexample, while exemplary network environments of the invention aredescribed in the context of a networked environment, such as a peer topeer networked environment, one skilled in the art will recognize thatthe present invention is not limited thereto, and that the methods, asdescribed in the present application may apply to any computing deviceor environment, such as a gaming console, handheld computer, portablecomputer, etc., whether wired or wireless, and may be applied to anynumber of such computing devices connected via a communications network,and interacting across the network. Furthermore, it should be emphasizedthat a variety of computer platforms, including handheld deviceoperating systems and other application specific operating systems arecontemplated, especially as the number of wireless networked devicescontinues to proliferate. Still further, the present invention may beimplemented in or across a plurality of processing chips or devices, andstorage may similarly be effected across a plurality of devices.Therefore, the present invention should not be limited to any singleembodiment, but rather should be construed in breadth and scope inaccordance with the appended claims.

1. A computer implemented method for generating a prediction query,comprising: electronically displaying a first user interface areaadapted to display a mining model and receive inputs matching a miningmodel to an input table; in response to a user input, electronicallydisplaying a second user interface area adapted to display mining modelsand receive a selection of a mining model; receiving a selection of amining model in the second user interface area and displaying theselected model in the first user interface area; electronicallydisplaying a third user interface area, the third user interface areaadapted to display a database schema and receive an input matching aninput table displayed in the third user interface area with a miningmodel displayed in the first user interface area; receiving in the firstuser interface area and the third user interface area an input of atleast one line segment between at least one column of the mining modeland at least one column of the at least one input table; and in responseto receiving the input of at least one line segment, automaticallygenerating a prediction query and displaying the generated predictionquery in a fourth user interface area.
 2. The computer implementedmethod according to claim 1, further comprising: joining at least onecolumn of a first input table with at least one column of a second inputtable.
 3. The computer implemented method according to claim 1, furthercomprising: executing said prediction query thereby producing at leastone prediction result data set.
 4. The computer implemented methodaccording to claim 1, wherein said at least one input table is at leastone relational table.
 5. The computer implemented method according toclaim 1, further comprising: displaying a fifth user interface area, thefifth user interface area adapted to display a selection grid area anddisplay elements selected from the mining model displayed in the firstuser interface area and display elements selected from the input tabledisplayed in the third user interface area.
 6. The computer implementedmethod according to claim 1, wherein displaying the prediction query ina fourth user interface area comprises displaying query syntax of thegenerated prediction query.
 7. The computer implemented method accordingto claim 1, wherein said selecting at least one mining model includesselecting one of a trained mining model within an opened project and anexisting model from a server.
 8. The computer implemented methodaccording to claim 1, wherein said receiving a selection of at least oneinput table includes receiving a selection of one of a table fromexisting Data Source Views and a table from a server.
 9. The computerimplemented method according to claim 1, further comprising:automatically displaying a mapping between an element from a model ofsaid at least one mining model and an element from a table of said atleast one input table, when the elements have same name.
 10. A computerreadable storage medium having stored thereon computer-executablemodules for generating a prediction query, the modules comprising:computer executable code for electronically displaying a first userinterface area adapted to display a mining model and receive inputsmatching a mining model to an input table; computer executable code forin response to a user input, electronically displaying a second userinterface area adapted to display mining models and receive a selectionof a mining model; computer executable code for receiving a selection ofa mining model in the second user interface area and displaying theselected model in the first user interface area; computer executablecode for electronically displaying a third user interface area, thethird user interface area adapted to display a database schema andreceive an input matching an input table displayed in the third userinterface area with a mining model displayed in the first user interfacearea; computer executable code for building a relationship between saidat least one input table by joining columns between input tables;computer executable code for receiving in the first user interface areaand the third user interface area an input of at least one line segmentbetween at least one column of the mining model and at least one columnof the at least one input table; computer executable code for, inresponse to said joining, automatically generating a prediction query;and computer executable code for automatically displaying a mappingbetween an element from a model of said at least one mining model and anelement from a table of said at least one input table, when the elementshave same name.
 11. The computer readable storage medium according toclaim 10, further comprising: computer executable code for executingsaid prediction query thereby producing at least one prediction resultdata set.
 12. The computer readable storage medium according to claim10, wherein said at least one input table is at least one relationaltable.
 13. The computer readable storage medium according to claim 10,further comprising: a displaying component for displaying a table columnmapping area and a selection grid area.
 14. The computer readablestorage medium according to claim 10, further comprising: codeexecutable code for displaying query syntax of the generated predictionquery.
 15. A computing system for generating a prediction query,comprising: a computing processor; computing memory communicativelycoupled with said computing processor; means for electronicallydisplaying a first user interface area adapted to display a mining modeland receive inputs matching a mining model to an input table; means forin response to a user input, electronically displaying a second userinterface area adapted to display mining models and receive a selectionof a mining model; means for receiving a selection of a mining model inthe second user interface area and displaying the selected model in thefirst user interface area; means for electronically displaying a thirduser interface area, the third user interface area adapted to display adatabase schema and receive an input matching an input table displayedin the third user interface area with a mining model displayed in thefirst user interface area means for receiving in the first userinterface area and the third user interface area an input of at leastone line segment between at least one column of the mining model and atleast one column of the at least ans for automatically, in response tosaid means for joining, generating a prediction query. one input table;and means for automatically, in response to said means for joining,generating a prediction query and displaying the generated predictionquery in a fourth user interface area.